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Docking Mechanisms: Some European 

Development Programs 
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Docking Mechanism Design: 

Analysis of Front-End Requirements & Verification Tools 
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Overview of CNES Rendezvous 
and Docking Activities 
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Video-Based Sensor for Autonomous Docking 
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Description and Performances of the MATRA CCD Camera Sensor 
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Laser Docking Sensor 


O 


S' u M C 

S « g. u o 
8 fc! “ <3 a 
" O <u E S 
« > 22 55 

C < - i« C 

60 5 *- § 

- z m uQ 
c Jg .5 S- 2 

J3 *5 c CO -C 

O •-* 60 

« E w is 
w £ E « E 

*T*« 

CJ w 60 

£■ 0^6 
w O T3 O 5 

„ -a n 2 

•s S >> £ 

•e £ « = ^ 

? s s - 

c . 3 g O 
O W) O P 
« o Q > 

* 73 w t> C 
« .2 5 o 

* -s Q> * W 

H W fc- 

i : 1 1 a 

o cj zo 
p m x ^ 11 

*o 2 ^ co 

o ^ n ^ w 

jo ’j 7o-S 

•p o <u 

£ 55 £> > c 

» O T3 <D •** 
O Cc "O 

> -5 1 gp § 

•S * 5 *5> _ 
g X) o 
00 2 *- 

.5 C a .52 ^ 

ii "^1 

» v | Q u 

. I 2 

55 1 g J 2 o. 

3 s . s H « 

* C « ~ 5 

a o 3 .Si .2 

5 ■§ * | ^ 

60 00 o «3 

G c w 60 

3 a£-S 6 

T1 C O _ 


0 

s. 

c 

<L> 

0 


ro 

*-* 

0 

<U 

? 

<a 

O* 


CO 

a> 

a> 

CO 

VO 

On 

c 


x> 

G 


*o 

C/J 

O 

ON 

*+3 

•3 

2 

CO 

C 



•3 'a g 3 £ 

rr Cd t — 1 o ^ 

5 O o o o 

ry> C-> -a 1 *-' 

* 85 9 < , 
s C 5 S| 
jjj 8 £ •§ 2 | 

J 3 .2? K « ^ 

< 5 E §, *5 ^ 


1-19 



Hybrid (Optical and Digital) Image 
Processing for Vision-Based Control 
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Autonomous Rendezvous and Docking 
System Design and Simulations 
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FOR EARLY IDENTIFICATION AND SOLUTION OF KEY ISSUES AND ALSO TO PREPARE THE APPROPRIATE 'TOOLS FOR 
DEVELOPMENT AND VERIFICATION. 

THE EARLY TECHNOLOGY ACTIVITIES, THE BASELINE CONCEPTS OF THE HERMES AND COLUICUS PROJECTS AND THE 
CURRENT TECHNOLOGY PROGRAMMES AIMED TO PROVIDE EARLY PROOF OF THOSE CONCEPTS ARE PRESENTED. 




CONCEPT CURRENTLY BEING RECONSIDERED FOR USE IN LOGISTICS VEHICLES. 
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£53^11 iLN DESIGN COMPATIBILITY OF GNC AND DOCKING/BE R THING SYSTEMS 











UTILITIES (EXCEPT HAZARDOUS) SHALL BE ROUTED AND CONNECTED INSIDE PRESSURISED VOLUME WITHOUT 
OBSTRUCTING PASSAGEWAY. MANUAL CONNECTION BY JUMPERS. 



HERMES DOCKING SYSTEM 
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PASSAGE. STRUCTURAL LATCHES HAVE TO COMPRESS SEALS BETWEEN BOTH DOCKING MECHANISM HALVES TO 
PROVIDE NECESSARY AIRTIGHTNESS AND TO SUPPORT PRESSURE LOADS (INTERNAL PRESSURE OF 1 atm IMPLIES 
250,000 N SEPARATION FORCE). COMPATIBILITY WITH COLUMBUS FREE FLYER SYSTEM IMPOSES THE LATCH 
DESIGN CONCEPT AND NUMBER OF ATTACHMENT POINTS: 16 BOLT/NUT LATCHES. EACH LATCH IS DRIVEN BY A 
DEDICATED GEARMOTOR. 







fWMl; 4. TECHNOLOGY INVESTIGATIONS ON DOCKING SYSTEMS AND DOCKING DYNAMICS 
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LIFE AND MAINTENANCE (SPECIALLY CRITICAL IN CASE OF CFF) . 

OPERATIONAL ASPECTS AND RELATIONSHIP WITH OTHER DBS ITEMS: STRUCTURAL STIFFNESS VS MASS VS 
RELATIVE DEFLECTION, NUMBER OF STRUCTURAL LATCHES VS MASS VS FAILURE TOLERANCE,.. 
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• SHAPES (SPATIAL, HIGH-ACCURACY, POSITON-ENCODING 
Simultaneous measurement of the 3-D position of 
multiple targets 



RANGE ESTIMATION FROM IMAGE SIZE 
OF A KNOWN OBJECT (TACHYMETER) 
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V _ ' (DETERMINATION OF TILT DIRECTION REQUIRES 

Sensor View of ADDITIONAL RETROREFLECTOR/BEACON ) 

Target array 



Range Estimation from Image Size 
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Range Estimation from Image Size 



Error analysis of the above indicates o a ~ 3o x , where o x = image centroiding error 
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RANGE ESTIMATION FROM IMAGE SIZE 
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The minimum range can be reduced by a second set of reflectors/ 
beacons with reduced spacing, (e.g., if L = 10 cm, Rmm = 1 m.) 









Vertical Arrangement of GLAM-VISTA Antennas 



GLAM-VISTA ANTENNA POSITION SENSORS 
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Lateral Cell Photodiodes - Measuring transverse position of a single target 
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Lateral Cell Photodiodes - Measuring transverse positions of multiple targets 


III! 


1-52 



Multiple Image Lateral-Effect Photodiode 


CD 

~ E o 

O) CD ~ 

©f 

tC (/i ifl 
5 =3 c => 

8 E .2 .2 

1^1.1 

■n O OT ^ 

Ci 3 3 

= c5o = 

8 ®2-S 

12-58 

2 8,>-o 

03 E? CO 

CD 


CD 

£ 

c 

o 

CO 

“O 

c 

CD 

Q. 

CD 

*D 

“D 

CD 

> 

CD 03 
CO r- 
-Q 

o 

CD 
-Q 


^3 co § 
^c.2a 

C O O 


O) 
*C 0 

-C 

o 
c os 
03 CD 

O H- 
, - o 

03 


cd 5-JZ is 
•r; y «•— -n 


"D C 
Q O Q) ' f ““ 
a_~ 3 C 

.9- S a\o 

Z3 .9 <D **£2 

cr-S >£= -2 
o 2 Q3 =3 
Q)Sl3 

a_ © o 

w°(5E 

r- ■*-» 


© 

w Pwi: 


§2 S3 

•S © <n o 

'7Z m -y 


T3 
CO > 

©I 

E>g 

®j§ 

2.1 
5| 
|8 
i £ 

03 © 


CO O) O CO 
O .E 03— 
CO © 


CO 
03 
CD = 

^ ^ O) CD 

* E CD 52 CO £ 
CO 

o* 


_ W t~ -■ 

o 2-c C 

© 


% o ° 
■O =J=£ 

$ „ OTJ 

8-8*1 

2? £c 

E-® 22 

Olv **— T“ 

.E © >* £ 

as o co 2 

® x> © 2 

9- © -ts c 

© "O -r sz 
-E o ~ 

»“ E 


© 

© 


© 

o 

E © 

25 

5 5 

. 2 > > 

CO _© 

© c 
£.2 
© © 
© 3 

.2 0 


o © JZ 

© u_ ,o> 


O 

_Q 

© 


o © 

.2 Q. 


0 © 
P c 
o 

CO 


3 

© 


X .E 

LU O 


c 

o 


CO 

< 


CO 

p 

CO o 

o' © 

■E Q o 

o "D 0 

jS 2 

D_ .-L 

~ 3 — 

— 3 

© ^ 


© O 


3 

CO 

© 

© 

E co 

E 


■o 
© ^ 

Q-*- -a .-tr 

O *- <}} 

C 


o 

D) 


CD £ — 

> r 55 ■“ 

© o CO ® 
T3 0 0 — 

°>§-°g 

Iff 8 

«:I g o 

fc- co CD r 

S 8 « o 

o °-© ^ 
© © jz © 
0 0 I — ."2 
■o © . 0 

= _r © > 
© ^ co »- 
O C co o 

— £5 co M_ 

2| a,? 

2 1 a 8 

iS f 9o 

^ VJ LL. 

© 0 »_ 

2>E< 

© £ CO 3 

.1 cn-Qi: 
±; >* i= 0 
3W g « 

^ g -a .a 
glUx 

— O ^ a) 
I- LL 03 q= 


3 

0) 

3 

O 


CD 


1-53 



SHAPES: SPATIAL, HIGH-ACCURACY, 
POSITION ENCODING SENSOR 
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JPL SHAPES OPERATING PRINCIPLE 
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SIMULTANEOUS RANGING TO MULTIPLE 
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SHAPES 3-D BREADBOARD 
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Docking Mechanism Design : Analysis of Front-End Requirements 

& Verification Tools 
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Power Consumption 30 Watts 10 Watts 



Accuracies and Noise Levels 


The accuracy of the sensor is a function of range, as are 
the noise levels. The longer the range, the more noisy and less 
accurate the data is. This stems from the fact that the lens is 
a fixed-focus lens that is focused at close ranges, so the long 
range picture is blurred, leading to variations in the target's 
reflections between frames and causing greater digitization 
inaccuracies. However, it was decided that the greater accuracy 
is required at close ranges rather than far ranges. A larger 
target that uses corner-cube retro-reflectors has a much steadier 
return at longer ranges, and it has a maximum range of 150 feet 
with the current sensor. 
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Error (ft) 


Sensor Error vs. Range 



Range (ft) 





Planned and Potential Uses 
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Planned and Potential Applications 
for the Video Based Sensor 
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Description and Performances of the MATRA CCD Camera Sensor 
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Utilization of MATRA CCD Camera Sensor within European RV System Pre-Development 
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Specifications used for Sensor Design 
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Functional Overview of the MATRA CCD Camera Se 
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Operating Modes of the MATRA CCD Camera Sensor 
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other missions (HMS/CFF sun-pointing, HMS/SSF) do not change overall performance 
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Testing of MATRA Sensor on Docking Dynamics Test Facility 
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Testing of MATRA Sensor on European Proximity Operations Simulator 
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LASER DOCKING SENSOR 
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SCHEDULE DRIVEN BY FUNDING PHASING 
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AUTONOMOUS RENDEZVOUS AND 
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LASER DOCKING SENSOR 
PROGRAM OVERVIEW 
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MAX ATTITUDE RATE (fine): + 6 Deg/sec 0.03 Deg/sec 

MAX ATTITUDE RATE (course): TBD Deg/sec TBD Deg/sec 

Maximum attitude range is 100 meters 
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Passive Imaging: Video or IR Cameras 
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Applied Research Incorporated is developing a technique to derive 
attitude measurements using a single retroreflector (NASA JSC funded 
Phase il SBlH) 



Hybrid (Optical and Digital) Image 
Processing for Vision-Based Control 
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Hybrid (Optical and Digital) Image 
Processing Vision -Based Control 

Richard D. Juday 

Tracking and Communications Division 
NASA Johnson Space Center 


ABSTRACT 

Hybrid vision is the result of image processing that is partly digital, partly optical. 
The Johnson Space Center program is discussed. Its main elements are spatial light 
modulators, video rate image coordinate transformations, Fourier optics filter 
optimization for signal- to-noise ratio, and synthetic estimation filters. A bibliography 
is given. 


I. Introduction 

Hybrid vision is the result of image processing that is partly digital, partly optical. Pattern 
recognition by digital image processing is a well enough known discipline, but in this context we use 
digital processing more for control interaction with a vision system than for pattern recognition. The 
pattern recognition is done by Fourier optics, with the heavy duty aspects being done using off-line 
calculations. The advantages devolving from the Fourier optics aspects are its speed and a possibly 
reduced amount of sensitivity to obstruction, deep shadow from solar illumination, etc. The Tracking 
and Communications Division has been working on hybrid vision for several years 1 " 36 . The elements 
are control system applications of correlators 1 ' 13 , spatial light modulators 14 , methods of optimizing 
filters that are expressed under the constraints of real spatial light modulators 13 ' 22 , video rate image 
warping for machine vision applications 23 ' 28 and human low vision 3 ®' 31 , and some techniques 34 ' 36 
that were developed under funding from the Mars lander project. JSC has a memorandum of 
understanding with the U. S. Army Missile Command (MICOM) which is contributed to by the 
technology that is being developed. MICOM’s interest is in developing missiles sufficiently smart 
enough and with good enough vision to do an autonomous "docking” of a missile with a tank. The 
analogy with spacecraft docking is immediately obvious. NASA wishes to reuse the system and hopes 
for a lower closing speed. 


II. Correlation as a measurement tool 

In hybrid vision, the information extraction is performed by optical correlation. An image is encoded 
by an input spatial light modulator operating on coherent light. Most of our work uses VanderLugt 
type correlation 1 " 6,8,10 ' 12,16 ' 22 and some 7,9,34 ' 36 uses the joint transform. For autonomous rendezvous 
and docking applications there are two major technical elements, the "backscratching" algorithm 10 and 
the synthetic estimation filter 2,3,8,8 ' 11,13 . Correlation, whether done optically or digitally, measures 
the degree of resemblance between the viewed object and the reference object. Optical correlation 
is notably susceptible to changes of appearance of the viewed object that one would ordinarily not 
wish to degrade the measurement. Scale and rotation sensitivity are the prime examples. We 
developed the backscratching algorithm to compensate. Measurements alternate being made in the 
ordinary Cartesian geometric representation of the object — which allows centration of the object-- 
and in the log-polar representation, which allows imaging optics to correct the rotation and 
magnification of the image. 
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III. Pose estimation by SEF 


Two bodies are spatially related by only six degrees of freedom. For AR&D purposes we separate 
them as • allows. First and second are the latitude and longitude of the viewed object in the "sky" of 
the other. Third and fourth are the latitude and longitude of the viewpoint in the sky of the viewed 
object (this corresponds to out-of-plane motion of the viewed object). Fifth is the distance between 
viewer and object (roughly equivalent to in-plane scale). Sixth is the relative rotation of the pair 
about the line of sight (exactly equivalent to in-plane rotation in the imager plane of the viewing 
system). As mentioned in Section II we can use correlation under Cartesian and log-polar 
representation to make direct measurement of items 1, 2, 5, and 6 of this list. To handle items 3 and 
4, traditionally the more difficult parameters to estimate, we have developed the synthetic estimation 
filter (SEF) 2 ’ 3,5 ’ 8,9,11,13 that works as follows. Synthetic (i.e. composited) views of the object are 
created exactly so that correlation strength, plotted against pose, has affine variation. With the 
tailored variation, simple computations yield robust estimates of the pose from a very few correlation 
measurements. We have recently 11 extended the concept to multiple dimensions of pose. Compared 
to an exhaustive search of filters, each sharply responding to one pose of the object, a reduction of 
the number of filters to be searched seems likely to be on the order of a factor of eight. 

IV. Video rate image transforms 

A unique technical element at the Johnson Space Center is the Programmable Remapper 23 . It will do 
a highly arbitrary geometric transform of a Cartesian image fed to it at video rate. It fits into the 
hybrid vision scheme in that optical flow can often be transformed into a pure translation. The classic 
example is that the log polar transformation produces a shift- invariant image flow as a Cartesian 
sensor is approaching normally to a plane. Optical correlation is by nature a shift-invariant operation, 
and so to modify a video image to produce pure translation conforms it for input to a pattern- 
recognizing optical correlator. Because almost any geometric transformation of a 2-D image can be 
done at video rates, we have been investigating 29 * 31 the application of the technology to human low 
vision. The idea is to warp the version of the world presented to the low vision patient so as to make 
best use of the remaining viable retina. An analogy is that the image warping as possible with the 
Remapper could create a better "impedance match" between the low vision eye and the world. 

V. SLM's and SNR Optimization 

We have worked toward the creation of filters that take into account the nature of the spatial light 
modulators on which they are expressed. In one sequence of papers 16 * 17,21 we take into account the 
coupling between phase and amplitude. In others 12,16 we adapt to behavior of the SLM that is 
unknown in detail. Elsewhere 18 we adapt 

to phase filtering with a modulator that is of quite limited range; we routinely achieve solidly 
detectable correlations with a phase modulator that is limited to about one radian (cf. 2* for full 
ability). We initially 17 ’ 21 maximized only the central correlation value, but more recently 22 have 
begun a move into filters that optimize signal- to- noise ratio (SNR) for additive random noise of 
known power spectrum in the transform plane and also filters that optimize SNR when detector noise 
is included. 


VI. Summary 

The Johnson Space Center is actively working on several technological areas that are applicable to 
autonomous rendezvous and docking. 
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6.4 Supporting Data 

6.4.1 Doppler Measurements 

notating Diffuse Gone at 30' 


A i L 
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8/88 No offset optical 
modulator, electronically 
shifted to 40 MHz. 

Doppler causes basebariti 
foldover CNR - 40 dB in 
30 kl Iz 


translating Retro- Reflector at 20' 



2/89 Detector pre-amp 
output. Single 40 MHz 
offset modulator. 

Doppler shift = 141.5 kHz 
Velocity = 749.5 mm/s 
CNR - 80 dB in 1 kHz 
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AUTONOMOUS RENDEZVOUS & DOCKING SIMULATIONS AT MSFC 
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IDEAL FOR SYSTEMS EMPLOYING MULTIPLE SENSORS 
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ALL NETWORKS ARE TRAINED USING BACK- PROPAGATION 
ALGORITHM 
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NEURAL NETWORK APPLICATIONS IN AR&D AT MSEC 
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NEURAL NETWORK APPLICATIONS AT MSEC 
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